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ABST?.^CT 

This book presents the evaluation of a Primary 
Education Project (PEP) which focused on the development and 
evaluation of a model of individualized education for young children. 
The socioeconomic background of the participating students (primarily 
economically disadvantaged children attending an inner-city school) 
is described* The PEP 1969-1970 program included prekindergarten, 
kindergarten, and first grade classes. The curriculum for each grade 
level, described briefly, indicates four main areas: mathematics, 
classification, perceptual-motor skills, and reading. The PEP testing 
program, designed to assess and monitor student learning progress. 
Includes a placement and diagnostic pre- and posttest battery. Data 
concerning student learning outcomes are presented. In addition, 
comparisons are made among various PEP groups and between PEP and 
non-PEP classes. Also examined are the relationship between 
achievement and some possible predictors of learning success and the 
relationship between performance on the PEP curricula and on 
standardized tests* The results suggest that children in the program, 
on the average, are mastering the curriculum objectives developed for 
them. (SDB) 
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PEP IN THE FRICK EIXMENTARY SCHOOL: 
INTERIM EVALUATION REPORT 
1969-1970 



Margaret C. Wang, Lauren B. Resnick, and Patricia R. Schuetz 

Learning Research and Development Center 
University of Pittsburgh 

Introduction 

Tha Primary Education Project (PEP) is concerned with the 
development and evaluation of a model of individualized education for 
young children suitable for implementation in American public schools. 
The project is a joint undertaking of the University of Pittsburgh and the 
Pittsburgh Public Schools. The primary object of PEP is to develop an 
individualized early learning program to serve children from preschool 
through the primary grades. The PEP individualized instructional model 
has been under development at Frick Elementary School in Pittsburgh 
since September 1967. It is concerned with all aspects of school func- 
tioning- -curriculum, classroom organization, teacher training and staff 
development, and work with parents. The instructional model incorpo* 
rs^tes both developmental work and basic research with respect to the 
concerns of school functioiing. 

Initial work in PEP has focused on the development and evaluation 
of hierarchically sequenced curricula which promote early and continued 
success in learning by assuring that key prerequisites for successive 
levels of achievement are established before each new step is taken. 
The PEP early learning curricula emphasize basic skills and concepts 
that underlie a variety of subject matters. These are skills and concepts 
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often measured in Intelligence and aptitude tests* and include basic per- 
ceptual -motor skills, language concepts and logical processes^ concepts 
of number, etc. , as well as the fundamentals of reading (Re snick, 1967)* 

Based on the objectives specified for each of the PEP curriculum 
areas, criterion* referenced placement and diagnostic tests have been 
developed for use in a testing program designed to diagnose and monitor 
each child's learning progress in the PEP curriculum. In actual use in 
the classroom, testing is informal and individual^ and continues through- 
out the school year; as a child completes an objective or unit of objective s» 
he is pretested to establish a new starting point for further work. 

Instructional procedures in PEP classrooms vary according to 
Age group. In general, the school day begins with a ''prescribed learning 
period, *' in which children work on individual assignments developed for 
each child on the basis of placement and diagnostic tests. A variety of 
materials are used, some borrowed from Montessori and English infant 
school programs, some designed by the PEP Research and Development 
Staff, and many constructed by the teachers. Children are taught to fol** 
low the prescriptions with considerable autonomy, sequencing their activi- 
ties, locating work materials, selecting an appropriate place to work, 
and requesting help as needed. 

Following the prescribed learning period, there is in many class- 
rooms an "exploratory learning period" in which children are free to 
choose their own tasks from a variety available in the classroom. There 
is no sharp time division between the two periods. Children move from 
one period to the other as they finish their prescribed assignments. 
Exploratory tasks include construction, socio-dramatic play, creative 
art work, science and mathentatics experiments, social studies projects, 
writing or dictating stories, and other language arts activities. The pur- 
pose is both to permit the child to apply his basic skills in a variety of 
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contexts, and to stimulate interest in new kinds of learning activities. A 
lonK-ranKe goal of the PEP research program is to investigate appropri- 
ate ways of combining prescriptive and exploratory modes of learning so 
as to maximize educational growth in many dimensions. 

F rick School 

Frick Elementary School, the developmental school for PEP, Is 
a Pittsburgh Public School situated near the University of Pittsburgh. 
AU of the Frick students live in the inner-city neighborhood in which the 
fichool is located. The majority of students are from economically dls- 
i lvantaRed families, a large proportion of them living In public housing 
projects within walking distance of the school. A small percentage of 
the Frick students are children of university faculty, staff, and graduate 
students, and other professional people. 

Socioeconomic Data 

Tables I to 4 summarize the socioeconomic background of the 
children who attended PEP classes during the 1969-1970 school year. 
These data were obtained from the student registration forms, which 
parents or guardians are required to complete in the school clerk's 
office when the child is enrolled. As indicated in Table 1, between 17 
and 38 percent of the children come from families with no father present. 
There was a large difference between preschool and kindergarten chil- 
dren and first grade children in the percentage of fathers at home. Thin 
may be explained by the fact that a number of children of university 
faculty and staff members attend Frick preschool and kindergarten 
classes but transfer to private school: when they reach first grade. 
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TABLE 1 



^opof tion of PEP Fathers Living at Home 





Preschool 


Kinder^rten 


first Grade 


. Average 


fathers at home 


83 1% 


75.9% 


58.9% 


74.2% 


fathers not d» home 










Deceased 


0.0 


2.« 


2.9 


2.3 


At>sent 


16.9 


21.5 


38.2 


23.5 



Of the children attending PEP classes, 83.8 percent were black 
(see Table 2). Of those fathers at home for whom information was avail- 
able, the median occupation level was that of ^ semi-skilled worker 

TA8L£ 2 
Racial Breakdown of f EP Students 



Preschool Kindergarten first Grade 
1 Black 78.1% 85.3% 89.9% 
2. White 17.3 13.8 9.3 
3 Other 4 1 09 0.8 
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(Table a category which includes such occupations as machine opera- 
tors, truckers, and security guards* The occupational scale is based on 
Holhngshcad's (1949) Occupational Categories, The median educational 
level of these fathers was that of a high school graduate (see Table 4), 
The occupation and education levels are somewhat higher than might be 
expected in an inner*city neighborhood such as Frick*$« However* it 
should be noted that the data are based only on those fathers who were 
reported to be living at home. Furthermore, even among the fathers 
who were reported at home, there was a large proportion for whom no 
information was available. It seems likely that most of these omitted 
cases fell in the lower educational and occupational levels* 



TABLES 

Occupational Levels of Fathers Living at Home^ 



Category 


Preschool 


Kindergarten 


First Grade 


Average 


1. Executive and Professional 


4.6% 


4.3% 


2.3% 


3.8% 


2. Managerial, proprietors of 
mediun)*$ized ^jsinesses 
and graduate students 


6.2 


2.6 


2.3 


3J 


3. Minor professional and small 
independent businessmen 


1.6 


3A 


4.7 


ZJ6 


|4. Clerical, sales and technicians 


7.7 


8.6 


6.7 


8.1 


&. Skilled labor and services 


10.8 


8.6 


7.8 


9.0 


6. Semi skilled labor 


23.1 


23.3 


18.6 


21.3 


7. Unskilled labor 


26.2 


20.7 


16.3 


19.0 


8. Unemployed 


6.2 


5^ 


7.0 


6.2 


9. No information 


13.8 


23J 


34.9 


24.6 



o 

C/5 



^Figures reported m this table are based on the "fathers at home." as reported in Table 1. 



ERIC 



09008 



TABLE 4 

Educational Levels of Fathers Living at Home^ 





Preschool 


Kindergarten 


First Grade 


Average 


1. Graduate degree 


4.6% 


4.3% 


0.8% 


2.9% 


2. Graduate school 


?.? 


1.7 


1.6 


2.9 


3. College graduate 


.0 


1.7 


2.3 


1.6 


4. Highsthool^ 


?.? 


12.1 


9.3 


lao 


6. High school graduate 


32.3 


66.0 


48.1 


47.7 


6. dth- 12th grade 


9.2 


16l& 


2S.6 


ia4 


7. 7th - 6th grade 


1.6 


4.3 


6.2 


4S 


8. Belowgradefi 


1.B 


.6 


2.3 


1.6 


d. No information 


35.4 


3.4 


3.9 


103 



^Information was not avsllsble for most atnent fathers, figures reported in this table are based on the 
"fathers at home/* as reported in Table 1 . 



Pescrip tio n of the PEP 1969*1970 Cla sses 

Pre -Kindergarten , There were 23 children enrolled in the two 
classes for three-year-olds at Frick. The school day for the three -year- 
olds was from 12:30 to 3:30 p.m., Monday through Thursday. The total 
number of children enrolled in the four-year-old program was 33. Twenty- 
two of the children, randomly assigned to the two classes, had had one 
previous year with PEP. The average teacher-child ratio for the classes 
was 8.25 (a teacher and a teacher's aide were present in each class of 
16 or 17 children). The four-year-olds met from 8:30 a.m. to IIj30 
a.m. a Monday through Friday. 
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Kindergartctu There were six PEP kindergarten classes^ Three 
met from 8:30 a.m. to 1 1:30 a. m* , Monday through Thursday* Children 
whose fifth birthday fell on or before June 30 were assigned to the morning 
group* while those whose birth dates fell on or after July 1 were assigned 
to the afternoon group. Thus* children in the afternoon group were six 
months youngei*, on the average* than those in the morning classes* 

There were a total of 56 children enrolled in the afternoon classes. 
Sixteen, distributed randomly among the classes, had had previous PEP 
experience. The afternoon groups averaged about 19 children per class* 
Kiich class had a* teacher and an assistant teacher* There were a total 
of children enrolled in the morning kindergarten class, with an average 
clas& size of 17. Twenty *five children had previous experience with the 
PEP program. These children were randomly distributed among the 
classes. 

First Grade . A total of 133 children were enrolled in five first 
grade PEP classes at Frick. Of these, 104 had attended PEP kindergar- 
ten the previous year, while 29 were new to the program* Each class had 
approximately 27 pupils, a teacher, and an assistant teacher* Children 
were assigned to classes randomly with no ability groupir^ of any kind* 
First grade classes met from 8:30 a.m. to 3:30 p*m* (with a one**hour 
lunch break at noon)» Monday through Friday. 

Th e 1969-1970 PEP Curriculum 

Mathematics 

The PEP Quantification curriculum and the lower levels of the 
tPI Mathematics curriculum served as the core for the nnathematics pro* 
gram in PEP classrooms during the 1969-1970 school year* The PEP 
Quantification curriculum consists of 14 units: The first 8 units are 



designed to develop an operational number concept for sets up to ten» 
while Units ^ through 14 introduce higher numbers together with princi* 
ple& of grouping and place value fundamental to the decimal number sys- 
tem. Table 5 outlines the content of each of the 14 units. The methods 
used in deriving and sequencing objectives* together with a detailed 
rationale for Units 1-8 appear in a paper by Resnick, Wang, and Kaplan 
(1973K The Quantification curriculum was used in all PEP classrooms* 



TABLE 8 

Beginning Mathematics Program 
1969*1970 



Topic Number of Obiective> 



Quantification 

I. Counting 

Unit 1 -counting (1-6) 9 

Unit 2 -counting (6*10) 9 

Unit 9 -counting (11 -20) 4 

Unit 1 1 - counting (21100) 8 

Unit 13 -counting (101 1000) 6 

it. Numeratton 

Unit 3 - numeration (1-6) 7 

Unit 4 - numeration (6*10) 7 

Unit 10 - numeration (1120) 6 

Uitit 12 - numeratton (2M00) 16 

Unit 14 - numeratton (10M000) 12 

tit. Comparison of Set Si^e and Seriatton 

Unit 6 - comparison of set si^e 6 

Unit 6-sertdtion 4 

(V. Addition wO Subtraction 

Unit 7 - addition and subtraction 7 

Unit 8 - addition and subtraction equations 6 



Total number of objectives 104 
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The B and C levels oi the IPI (Individually Prescribed Instruction) 
Math curriculum were introduced to those children who completed all 
units in PEP Quantification. Topics included in Levels B and C o£ IPI 
Mathematics are numerationt place value, addition and subtraction, 
fractions, money, time, multiplication, division, systems of measure- 
ment, and geometry. Table 6 summarises the content covered and lists 
the number of objectives in each unit. The IPI Mathemadcs curriculum 
is described and discussed more fully in a paper by lindvall and Bolvin 
(I%7). 

TABLC 6 



tPI Mathematics Curriculum Used in the PBP Classes at Prick 
1969-1970 



Unit 


Topic 


Number of Objectives 


Level B 






B 1 


Numeration 


10 


B ' 2 


Place Value 


3 


B- 3 


Addition and Subtraction 


10 


B-4 


Fractions 


2 


B-6 


Money 


4 


B 6 


Time 


3 


B- 7 


Systems of Measurement 


4 


B~8 


Geometry 


2 


Total Numtmr of Ot^ectives 


3S 


Level 0 






c*' - ^ i 


Numeration 


7 




Place Value 


5 


C- 3 


Addition 




C- 4 


Subtraction 




C- 5 


Combination of Processes 




C- 6 


Fractions 




C 7 


Money 




8 


Time 


2 


C- 9 


Systems of Measurement 


2 


C- 10 


Geometry 


2 


C~ 11 


Special Topics 


1 


Total Number of Objectives 


43 
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Classification 

The PEP Classificatior curriculum is divided into three sections. 
Classification I covers the basic concepts of **same** and '^different** 
together with color, size, and shape diFcrimination. Classification II 
includes a number of specific language objectives. Classification III 
covers advanced discrimination and multidimensional classification skills. 
Table 7 summarizes the content of the three sections of the Classification 
curriculum. This curriculum was used with all children in preschool and 
kindergarten classes, and in first grade with children identified bv teachers 
as needing special work in these areas. 

TABLE? 



Classification Program 
1969'1d70 



Topic 


Number of Oblacthiai 


Dassif tcatton 1 




Matching Sicitis 




Unit t - l»slc matching skills 


6 


Unit 3 - advanced matching skills 


4 


Oiscriminitton Skills 




Uni^ 2 - shape and size discrimination 


4 


Unit 4 color naming 


2 


Unit S - shape naming 


2 


Unit 6 - size description 


4 


Unit 7 - advanced discrimination skttts 


12 


Total Number of Objectives 


33 


Classification II 




Identity Statements 




Unit 1 - singular and plural 


4 


Unit 2 - negative 


3 


Prepositk>nat Statements 




Units 3 and 4 - prepositions 


16 


Total Number o* Objectives 


23 


Classification ill 




Unit 1 - advanced cotor» size and shape discrimination 


9 


Unit 2 - functional category discrimfnatk>n 


11 


Unit 3 - category naming 


8 


Total Number of Obiecttves 


2d 
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•tin- fMTii |>tu;il-n»olor skills pr<i>tram usod during 1969-1970 
inrlii<U*<t iUv >.rm ral trmlor and visual skills components of the program 
outlined by Utism-r {IMf»M). Thv «cnrral motor skills curriculum is con* 



It i onlains HH «»l>ji-i liv« s in cM«ht units. The visual skills curriculum is 
drsiun«*d to trarh various disc rimination tasks involving position and 
orientation in a spatial matrix. Ihf program is built around a carefully 



tiviH in srvi-n units. 11ifsr programs wore implemented in the various 
PF.P i lassi H on an « xp«'rinM.ntal basis at different periods during the 
Hchoul y«'ar. 



Children in PKP first grades received reading instruction using 
a specially designed "iCarly Heading Program" (ERP), followed by the 
McCirawlfill Sullivan Associates' Proa rammed Re ading Scries. PEP 
reading msiruet :*.n stressed word decoding skills. ERP teaches children 
skills of sounding out and blending. It involves Individual tutorial sessions 

the outset* with c hildrcn moving gradually into small groups and then 
haek into individual w«irk in ih<^ Hi- adint* Se ries. The reading program 
was fornially itislitufed in the first grade classes beginning in January 
to70. hecause of the tutorial nature of the program, not all children 
beean insti uetion nt the same time; however, virtually all children in 
first grade had begun work in KUP by the end of the school year. The 
rationale for the PKP readmg program is given in a paper by Beck (1970). 

•1*1 !?'I!2i}Il^L Ctirric uhun 

Table H sufnmari/.es the core curriculum areas included for 
eaeh urade level during the I%9-I970 school year. 




ml fine motor development of the preschool child. 




>f pattern reproduction activities. There arc 83 objec- 



Re ading 
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TABLE 8 



Summary of Curriculum Components Used et Each Grade Level 



Curriculum Components 



Preschoi*. 



Kindergarten 



First Grade 



1. PEP Quantification 



X 



X 



X 



2. IPlMath 



Some advanced students 



3. Ctasstficatton 



X 



X 



Special work for a few 



4. Perceptual Skills 



5. Reading 



X 



*0n experimental basis 

The PEP Testing Program 

The PEP Testing Program, designed to assess and monitor 
student learning progress in each of the PEP curriculum areas* includes 
a placement and a diagnostic pre- and posttest battery (Wang, 1969)# 
The placement test battery was used at the beginning of the school year 
to place a particular child in the sequence of instructional tmits included 
in each of the PEP curriculum areas. The placements were also admin*- 
istered to new students who entered the program during the school year* 

The diagnostic tests were used to determine which particular sets 
of objectives within a unit a child needed to work on and, following instruc** 
tlon, whether he had mastered those objectives. After a child was placed 
in a mven unit {based on the placement test results), the child was f»iven 
the diagnostic tests for the objectives included in that unit to determine 
what particular objective(s) he needed to work on* During pretest and 
the first posttest, the child was given the diagnostic test only for the 
terminal objective(s) of any given unit* However, if the child failed to 
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pass the posttest a second time, he was given the diagnostic test for 
every objective included in that particular unit to determine further work 
in the unit. Diagnostic fests were administered to children orally and 
individually. Testing was carried out informally xn the classroom setting 
by one of the adults in the classroom (the teacher or the assistant teacher)* 
The amount of time spent on testing varied from child to child and from 
ago group to age group. On the average, a kindergarten or first grade 
child took three tests per test session; sessions lasted about eight min- 
utes for kindergarteners, and about nine minutes for first grade children 
(Wan« K SchuetT:. 1970). 

Student Learning Outcomes 

Two basic kinds of data are available for assessing student learn^ 
ing outcomes in the PEP program: (1) records of performance on the 
placement and diagnostic tests included as part of the various curricula; 
and (2) scores on standardized achievement tests administered at the end 
of the school year. In this section^ we shall examine both of these types 
of data, making certain comparisons among various PEP group? and 
betwe<^n PEP and non-PEP classes. In the following section, we examine 
the relationship between achievement and various possible predictors of 
learning success, such as socioeconomic variables, IQ, and entering 
performance level as measured by placement tests. We also examine 
here the relationship between performance on the PEP curricula and 
performance on standardized tests. 

Learning Prog ress in the PEP Curricula 

Mathematics . Table 9 shows the percentage of children at each 
age level who had mastered each unit (i* e. , passed the terminal test(s) 
of a given unit) in the Math curriculum at the end of the school year. 




TABLE 9 



Percent of Students Mastering Each Unit in the 
Quantification and the iPt Mathematics Curriculum at End of School Year 

1963*1970 











Age Group 






3yrs. 


4 yrs. 


Kindergarten p.m. Kindergarten a.m. 


first Grade 


Unit 


N*23 


N«33 


N»S6 N»&2 


N«133 



Quantification 



1. Counting 1*5 


59 


81 


93 


100 


93 


2. Counting MO 


32 


78 


88 


100 


91 


3. Numeration 0-5 


36 


75 


88 


80 


93 


4. Numeration 6- 10 


18 


66 


81 


V> 


81 


8. Comparison of sets 


6 


47 


90 


85 


85 


6. Sanation 


14 


34 


70 


77 


77 


7. Addition and Subtraction 


5 


6 


49 


se 


83 


8. Addition and Subtraction 












equations 




••• 


12 


21 


28 


9. Counting 11*20 


S 


28 


58 


63 


93 


10. Numeration 11*20 




6 


4t 


60 


86 


t1. Counting 20-100 






21 


27 


66 


12. Numeration 20-100 






4 


10 


38 


13. Counting 100-1000 








4 


19 


14. Numeration 










15 


Level 6 










4 


Level C 










1 



As can be seen* there is a steady increase with age in the percentage of 
students mastering each unit* With respect to content mastered* Table 
9 shows that almost all first-grade and about half of the kindergarten 
children could perform addition and subtraction operations with quantities 
up to ten (Unit 7); and many children were well advanced in work with 
higher numbers. Pre-kmdergarten children worked mainly in the lower 
units, learning counting, numerals, and one-to*ont» correspondence; but, 
a« can be seen, individual children in the three- and four-year-old groups 
were able to advance to addition and subtraction and work with larger 
numbers. 

The relatively low percentage of children in preschool and kin- 
dergarten classes passing U/.it 7 , and especially Unit 8, rejects teachers* 
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decisions to let some children skip over these relatively difficult units 
temporarily and return to them later^ A finding of this kind usually indi- 
cates some misordering in the curriculum. In this case, certain pre- 
requisites for Unit 8 had not been adequately learned* While skipping 
the unit and returning later was encouraged as a means of immediate 
adaptation* the R & D staff has also begun to investigate and make revi- 
sions designed to correct the problem* The revisions will be incorporated 
in a later version of the Mathematics curriculum* 

Table 10 shows the total number of instructional objectives mas* 
tered at the beginning of the school year (the entry level) and the total 
number of instructional objectives mastered by the end of the school year 
(terminal mastery) for each age group. As the table shows, there is a 
consistent pattern of increase with age in both the entry and the terminal 
levels of mastery. Figure 1 shows these results graphically. 



TABLE 10 

Entn* and Terminal Mastery Levels in Quantification 

Number of Instructional Oblectlves Mastered 



Entry Terminal 



Age Group 


N 


X 


S.O. 


X 


S.O. 


3*year-olds 


23 






12.09 


13.17 


4'year-olds 


33 


.64 


2.22 


29.36 


16.09 


Kindergarten p.m. 


56 


2.70 


5.78 


44.19 


18.23 


Kindergarten a.m. 


52 


3.74 


6.60 


50.94 


25.66 


First Grade 


133 


16.98 


16.07 


57.80 


23.66 
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One test of the effectiveness of the Quantification program comes 
from comparing the Fall entry level for students who had previous PEP 
experience with that of students who had not attended PEP classes* 
Table 11 shows these comparisons, giving the number of individual objec* 
tives mastered on the entering placement test for kindergarten children 
with and without PEP preschool and first graders with and without PEP 
kindergarten. As shown in Table 11, children at both grade levels who 
had a previous year of PEP performed significantly (p< .01) better on 
the Quantification placement tests than the new students* 

/ 



TABLE 11 

Comparifton of the Cuantif leation Entering Mastery Levels of the Students 
With and Without Prior PEP Experience 
Placement Test Results. Fall 1969 





Previous year in P^P 


New to PEP 








Grade Level 


Mean number of 
N obfectives mastered 


Meannumberof 
N objectives mastered 


Mast 


d.f. 


Significance Level 


Kindergarten 


41 4.98 


69 2.01 


2.68 


108 


.01 


first Grade 


104 ia95 


29 9.00 


2.92 


131 


.006 



Classificati on To examine student progress in the Classification 
curriculunrt, analyses of student learning outcome were performed simi- 
lar to those described for the Quantification curricula* The results are 
reported in Table 12. First grade data are not included in tiie table 
because Classification was not used on a regular basis for all children 
at that leveh 
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TABLE 12 



Stu€tent Mastery Summary 
Percent of Students Mastering Each Unit of the 
Ctasstfication Curriculum at End of School Year 
1969 1970 



Group 



Unit 


S yr old 


4 yr. old 


Kinderaartenp.m. 
N°56 


Kindergarten a.m. 
N-62 




Classification 1 






1. Matching 


77 


75 


85 


90 


2. Simple classtftcatton 


41 


66 


95 


94 


3. Classification of objects 








90 


varying in 2 dimensions 


50 


72 


96 


4. Color naming 


41 


60 


91 


98 


5. Shape naming 


41 


56 


88 


92 


6- St/e description 


9 


26 




73 


7 Advanced classification 


• 


19 




71 




Classification It 






1. Singular and plural obi. 


• 


ta 


74 


7S 


2. Reverse order ident. 


• 


3 


63 


63 


3. Freposittonai statemt. 


• 


• 


07 


56 




Classification III** 






1. Muttt-dimensional classtf icatton 




88 


71 


2. Classification of (unctional categories 




47 


71 


3. Category naming 






S3 


65 



*Unit not included in the curriculum for this age group. 
^^Classification III was not used in preschco! and kindergarten. 



As for Classification, increase in the mastery level with aj»e is 
apparent (Table 1 2). As an example, 50 percent of the three -year -olds 
mastered the unit on the classilication of objects varying in two dimen- 
sions, while 72 percent of the four-year-olds and 90 percent of both kin- 
dergarten groups mastered the same unit. 

A comparison was made of the entering mastery level of kinder- 
garten childrei who had a year of PEP nursery school With that of the 
children who were new to PEP. The returning PEP students scored sig- 
nificantly higher (X = IK 3) than new (X ^ 6.94) on the Classification 
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placement test given at the beginning of the school year. The differenced 
were statistically significant (p<*0005)« 

Perceptual Skills * Since the program was used with selected chil- 
dren and on an experimental basis, no summary data are reported here* 
The results from the experimental trials are reported in a paper by 
Rosner (1972). 

Readlntf > Table 13 gives the percentage of first grade children 
who had completed each successive level of the reading program. Rather 
low terminal mastery levels In the reading program are a function of the 
late introduction of formal reading instruction during the school year. 



TABLE 13 

Student Mastery Summary 
Percent of Students Mastering Each 
Book of the McGraw Httl. Sullivan Reading Series 





Grade 1 


Unit Topic 


N-133 


1. First transitional reader 


84.4 


2. Second transitional reader 


S8.4 


3. Initial and final consonant clusters; contractions 


48.9 


4. "ed" suffix of past tense vert>s 


40.8 


B. Inflectional and derivational suffixes "es" arul "er" 


31.8 


B. Inflectional and derivational suffixes "et" and "est". 




complex sentence structiir<»: paragraphs 


22.6 


7. New initial and final consonant clusters; suffix "ay" 


13.6 


8. Short "o"; "2" and "qu"; poems, descriptive paragraphs. 




short stories* colon 


10.S 


9. Final "y"; long "a" with final silent "e"; soft "c" 


8.0 


10. Long "•" and "o"; soft "g", longer stories 


AO 


1 1 Long vowels not followed by final silent "e". long "u" 


6.0 


12. Words ending in "oy" and "tgh". animal sounds, concepts 




"tiright" and "pale" 


4.6 


13. "ee", longer selections on natural sciences, with emphasis 




on comprehension and mtention. semi-colon 


3.0 


14. "ew". "oo". desaiptionsof natural ohenomena and human 




institutions, with emphasis on comprehension and retention 


3.0 


15. "ow". "ea". wh . ph . silent t and w . kn . ch . 




suffixes "ture" and "ation"; months and seasons' 


1.6 


16. "ould". "dge". silent "1" and "h". "wr", usage of "could" 




"should" and "would", history, with emphasis on com* 




prehension and retention 


1.6 
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Some children began work on ERP as late as ApriU As will be seen* the 
late start is also reflected in standardized achievement scores* which are 
low relative to mathematics scores* 

Performance on Standardized Achievement Measures 

So far» in this paper, we have addressed ourselves to questions 
related to student learning progress in the context of the PEP curriculum* 
using only our own criterion<*referenced evaluation measures. We will 
now ttxrn to the issue of how the PEP students rank in comparison with 
other students of their age and grade level based on national norms. 

The Wide Range Achievement Test (WRAT) was selected as the 
standardized norm-referenced achievement test for thib purpose. WRAT 
wab chosen for the following reasons: (I) Among the available standard* 
ized tests, WRAT items, with the exception of the spelling subtest, reflect 
most closely the content covered by the PEP curriculum objectives --this 
is especially true in the lower grade levels; (2) WRAT is relatively easy 
to administer and the testing time required to administer the test is not 
extensive; (3) for longitudinal evaluation of PEP, the WRAT, a single 
test that covers the span from nursery through high school grades, may 
be a more valid test to use for the purpose of evaluating the wide range 
span of student learning outcomes that an individualized program such 
as PEP expects to achieve; (4) WRAT provides us with comparison data 
on a nationwide basis. (The national evaluation program for Project 
Follow Through also includes WRAT in its testing battery. Project Pol* 
low Through is funded by the U.S. Office of Education and PEP was 
selected as one of the sponsoring models. ) 

All three Level I subtests of the WRAT (reading, spelling, and 
arithmetic) were administered to all PEP kindergarten and first grade 
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classes in May 1970. The reading subtest requires recognizing and nam* 
ing letters and recogni2ing words: tht- spelling subtest requires copying 
marks resembling letters^ writing one's name, and writing single die* 
tated words; and the arithmetic subtest tests counting, reading numerals^ 
solving oral problems » and performing written computations* Specifically, 
to compare the content covered by the WRAT with the PEP kindergarten 
curriculum objectives, items included in the arithmetic subtest were 
directly ^'taught for** in the PEP kindergarten classes, and some of the 
reading **readiness** skills tested in WRAT were included in the PEP 
Classification curriculum. In first grade, both arithmetic and reading 
were taught, but the reading program did not begin in the first grade 
classrooms until late in January 1970, so that at the time the WRAT was 
administered the first graders had only three to four months of reading 
instruction. Spelling was not included in either the kindergarten or the 
first grade curriculum, although some of the skills Included In the PEP 
Perceptual Skills Program were relevant to the lower level spelling tasks. 

The WRAT was also administered to second and third grade classes 
at Frick in May 1970. These classes, none of which had previously had 
the PEP Program, provide a natural "control group." Since they are 
I drawn from exactly the same neighborhood, it was assumed that second 

and third ^rade children would closely match first graders in socio- 
economic and other relevant student characteristics, such as ethno* 
cultural backgrounds. 

Since the initial plan for the implementation of PEP in Frick 
School was designed to begin the implementation at the lowest grades 
(preschool and kindergarten) and move into one more grade hierarchically 
for evaluation purposes, the grade one year ahead of the highest PEP 
grade seems to be the most appropriate comparison group from a practl* 
cal as well as a validity standpoint. Therefore, our evaluation plan calls 
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BIST COW wMuau 



for Ihf l omfMriHofi uf at ltirv(*tni*nf n-stilfs f«>r fhi* PKI* c laHHcs ami thf 
tmn- PKI* clitHHcs of \hv Hani*' ^ruflr h'vrl of Uh* prtwinun yrar, Utifor* 
liinatrly. w«- art* nf>t alifi^ to ccmiiMr** tin* WUAT r«*Hiills f>f ihr Pi;i* firKt 
Urailr (l'*f.M. |M70) and that of the rion PKP first «rafli« (P><»H- I V^»V), sinc f 
wo (lift not i»ivr Ihr WKATti* tlu- non-PKP first urailf c laKHt s in l%K-MK»9# 
N«*vfrtlif Irss. c*xatnination of sffoncl and Ihird ^radi- svort-K for Sprinj; 
P>7n providi-s an tnforttinl Ikinis fur .t.ssf^NNin^ tlir powi-r of PKP inlrr- 
vc«ntton« 

Tahli' 14 hIiowh thi* nic*an raw st ort' wtfti standard dt*viatton, and 
tlif fiifan i»rad<* fqiitvafi*nt f«>r rach of ilir WKA'I* std>ti*NtH for PI\P kinder- 
Karli*n and fir«f uraflf c lutilron and for non-PKP stuond and thiril ^iradorR, 
llir rtH'cli.iii ^.tvt» i*qiiivali'nt datti an Mhuwn Kraphicalty in Kimirf «!• Ah 
rfporff<l in lahlf I4» kindrrjjartoners pfrfornii-d tomfoflably abov<- ihv 
oxpcctod arlit<*vrnirnt of ktndi*ri*a rtc-n c htldrt*n on both rradinu ami artth^ 
mctti Htdd(*HtH (a ^radc cqiiivaU^nl f>f l\, ^) wi>tilfi Uv just avt«rai;t- ft>r M.iy 
t»f ih<* kttMi€T|*A rtcn yrarU *riu*y HCori*<} about imi* tnunth abr.id of >*rad(* 
Irvcl in rt*aditi^ and ftvt* months ahtsid in a rttlmuMic** 

First ^radfrs pfrforni«"d about tw«> montlts .ilir.ul f>f thrir ^railf 
tfv<"l in arithrru'tir, thi* artsi in whirli their insf ructiottal program was 
bcHt dfvflup«*f!. In rradin^ th«'y pfrformnl not fpiiti* .it fh«" ^•radf IfvoU 
riw t'fM'lf ••«|«»t V.I !«mU Hi nro shows .ilK»ut om* ttifinth twhiuil. Tins rfsiilt 
must Im* intrrf>rr*i'd m lh«» Uuht «>f thf latf start In rcsulin^; inst rtirtitm in 
IMvf* i lassi-s. Inst rurf ton b«*^an in .l;inuary« with many individuals br^in* 
mnu l.itc-r. hc» itiat l>y tht* titiu- iho U'st was aihtiiniHti*r«-d, cfiildrrn liad 
r#Tfivrd fron> /vn* to fivr months nf inHtruction rather than Ihi' •*norm.il" 
nthc* months. Hit* third |*ra(h'rH pi*rformc*d about nim* months bt*htnd 
thfir urach* Irvi-I in readini*. 'Hh* r«»su|ts srrm to sii^urst that the niui- 
PRPc'lassfs at FrifJt show evidenit of .i ilevelopin^t *'c iimulati vi* deficit** 




1 

flC 

I 

Mi 



IX 



i 



J 



i 



9 ft 



S 5 



8 9 



i8 se 8 « 

WW Hi itf 



i 8 ^ Pt 



8 9 8 {3 



a I 



8 3 8 8 



IP I «» ff« H 



S 3 



8 n ^ ^ 



. I 1. I S 



ERIC 



23 

00026 



while PEP classes show promise of having broken the cycle by perform- 
ing strongly in the first grade. 

In order to be certain that the observed differences between PEP 
and non-PCP classes were not functions of the differences in socioeco- 
nomic status of the two groups* a comparison was made of WRAT scores 
of those PEP students who had siblings in the second or third grades and 
scores of their older siblings. Table 15 reports the mean raw score, 
median grade equivalent* and median percentile rank of each WRAT sub- 
test, for each of the comparison grade levels of the 1969-1970 school 
year. Comparing Table IS against Table 14, the results seemed to be 
substantially the same, indicating the PEP students in general scored 
higher on the WRAT than the non*PEP students in Frick School* 

An examination of changes in scores over time should permit 
some assessment of the success of our development effort in improving 
PEP. As the PEP curriculum and Its implementation are refined, scores 
should improve. Two years of data were available for the kindergarten, 
and WRAT scores for these years are compared in T^ble 16* For the 
two curricular areas included in the PEP program, arithmetic and read* 
ing (readiness), a substantial improvement from 1969*1970 is observed* 
However* no improvement in the spelling scores is shown* Since we did 
not engage in any developmental work in spelling, no improvement result 
was expected. In general, the effects of deliberate attention paid by the 
LRDC curriculum developers and the school staff to particular curxiculum 
areas is reflected in improved achievement scores* 
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TABLE 16 

Comparison of WRAT Achievement of the 
1968-1969 and the 1669-1970 Kindergarten Classes 









WAAT 




f cr t;urricuium 
Mastery Lfvei 


Group 


N 


Reading 


Arithmetic 


Spelling 


Quantification Classification 


1968*1969 


130 


0.7 


1.0 


0.7 


28.12 25.61 


1969*1970 


103 


1.0 


1.4 


0.6 


47.67 53.46 



General Discussion 

Results from this second year of the PEP program at Frick School 
offer grounds for considerable optimism concerning the effectiveness of 
the general approach of the project* Children in the program are» con<- 
sidered on the average, clearly mastering the curriculum objectives 
developed for them* Comparisons with older children in the same school 
suggest marked progress toward breaking the cycle of **cumulative defi* 
cit** that is typically found among children of poor and minority background* 
In general, children using the PEP curricula have median grade equiva** 
l^nt scores above those expected for their age; children not using the cur« 
ricula have median scores below those expected for their age* The gen** 
erni fmoing is* then, that the preschool, kindergarten, and first grade 
children at Frick are responsive to the instruction being offered* They 
are learning what they are taught, and their performance compares favor- 
ably with the compari':on groups identified for the study* 
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A particular pattern in the data should be noted and considered at 
this point. This is the fact that improvement in learning appears to be 
highly specific to the areas in which direct instruction was received. 
This specificity effect is seen in several places* The mean WRAT scores 
for spelling, for example, were low for the PEP children as well as their 
non-PEP older siblings and neighbors. This result reflected the absence 
of specific instruction in spelling in the PEP program. The results also 
showed that the first graders did not score as high in the reading subtest 
as they did in the arithmetic subtest, and this reflects the late introduc- 
tion of the formal reading curriculum during the first year of its use- -it 
is a differetice we hope to see reduced or eliminated as reading instruc- 
tion becomes more extensive and well-implemented. 

The overall results seem to indicate that PEP is successful in 
teaching the concepts and skills in subject areas in which it specifically 
offers instructions* This particular finding is encouraging. It is encour- 
aging because we have clear evidence that poor-prognosis children can 
learn standard school curricula when they are systematically and care- 
fully taught* using hierarchically organized mastery curricula. With 
more of this kind of teaching, we should be able to look forward to even 
greater student achievement. However, the lack of generality of learning 
to subjects not explicitly taught suggests that one of the early objectives 
of the PEP project (see Resnick* 1967) has yet to be met; namely, the 
teaching of generalized learning skills that will allow children to prosper 
without the support of highly structured instruction in every area of 
endeavor. 

This finding sets a major task for future work in individualized 
and adaptive education: the definition of generalized skills of learning 
and the development of ways of teaching these skills to children of vari- 
ous ages. It also poses an interesting set of research questions surround 
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Ing the relationship of Renoral learning abilities* or "intelligence/' and 
school achievement in adaptive settings. Given the specificity of learning 
effects found here, one would expect entering perforniance in the instruc- 
tional curricula themselves, rather than IQ or other general ability meas- 
sures* to be the major determinants of end of the year learning outcomes* 
Some early evidence on this question Is presented In another paper (see 
Resnick Sr Wang, 1974). Meanwhile, our own work and that of many of 
our colleagues at LRDC is Increasingly directed at exploring the relation- 
ships between aptitudes and achievement in adaptive learning environments 
and at the development of ways of enhancing general learning abilities In 
young children. 
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